Limit on sterile neutrino contribution from the Mainz Neutrino 

Mass Experiment 



Christine Kraus^, Andrej Singer^* Kathrin Valerius^^and Christian Weinheimer^-'- 

^ Laurentian University - 935 Ramsay Lake Road, Sudbury P3E 2C6, Canada 
^ Institute of Nuclear Physics, Westfdlische Wilhelms- Universitdt Miinster, 
Wilhelm-Klemm-Str. 9, 48149 Miinster, Germany 

October 17, 2012 



Abstract 

The recent analysis of the normahzation of reactor antineutrino data, the cahbration data of solar 
neutrino experiments using gallium targets, and the results from the neutrino oscillation experiment 
MiniBooNE suggest the existence of a fourth light neutrino mass state with a mass of C'(eV), which 
contributes to the electron neutrino with a sizable mixing angle. Since we know from measurements 
of the width of the TP resonance that there are only three active neutrinos, a fourth neutrino should 
be sterile (i.e., interact only via gravity). The corresponding fourth neutrino mass state should be 
visible as an additional kink in /?-decay spectra. In this work the phase II data of the Mainz Neutrino 
Mass Experiment have been analyzed searching for a possible contribution of a fourth light neutrino 
mass state. No signature of such a fourth mass state has been found and limits on the mass and the 
mixing of this fourth mass states are derived. 

1 Introduction 

Experiments with atmospheric, solar, reactor and accelerator neutrinos gave compelling evidence that 
neutrinos from one flavor state can be detected in another flavor state after some flight distance. This 
well-established phenomenon neutrino oscillation is usually explained by neutrino mixing: Firstly, the 
three flavor neutrino states z/o, v^i and Vr are superpositions of three neutrino mass eigenstates J^i, V2 
and connected by a unitary 3x3 mixing matrix U . Secondly, neutrino oscillations require that 
the three neutrino mass states differ in masses, i.e. at least two neutrino mass states Vi possess non-zero 
masses. Neutrino oscillation experiments yielded the three mixing angles [siv? 623 = (3.86lg'2i)-10~^), 
6*12 (sin2 6'i2 = (3.07i^:i^) • lO"!) and recently 613 (sin^ 6I13 = {2.41^0^1) ■ IQ-^), as well as the two 
splittings between squared neutrino masses Amfj = 771^(1^2) ~ m^it^i) = (7.54^q'22) • 10~^ eV^ and 
l^"^23l = l'™^('^3) — ™^('^2)| — (2-43lg J^q) • 10"'^ eV'^ (all values quoted after jjj, using conventional units 
with c = 1 and h = 

Nearly all these oscillation experiments - performed with neutrinos with very different energies, differ- 
ent flavors, different flight distances and with/without matter effects - can be described by three neutrino 
mass and three neutrino flavor states connected by a unitary 3x3 matrix. Yet, there is an increasing 
number of hints that this picture is not complete: There is the request for at least one additional scale 
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of neutrino squared mass splittings Am^ — 0{eY) from the so called reactor neutrino anomaly [2], the 
normalization of gallium solar neutrino experiments jSl HI O IS| i and from the accelerator neutrino ex- 
periments LSND [7 and MiniBooNE [8 . Although cosmology gave hints that the number of neutrino 
degrees of freedom is rather four than three, introducing an eV mass scale is not trivial [9 . Since we 
know from the LEP studies of the pole that the number of active neutrinos coupling to the and 
the Z'^ bosons is 2.9840 ± 0.0082 [TOj the fourth neutrino has to be sterile. By neutrino mixing the fourth 
neutrino state will become visible in neutrino oscillation and direct neutrino mass experiments The 
existence of sterile neutrinos is quite natural, because most theories describing non-zero neutrino masses 
exhibit right-handed and therefore sterile neutrinos. What is less natural is the cV-scale discussed here. 
A summary of the physics and searches for sterile neutrinos can be found in a recent white paper |12) . 

Our paper is organized as follows: In section 2 we discuss the influence of a fourth sterile neutrino 
on the spectrum of an allowed /3-decay. The Mainz Neutrino Mass Experiment is described briefly in 
section 3. In section 4 we present the result of a sterile neutrino search in the phase II data of the Mainz 
Neutrino Mass Experiment before we give a conclusion and an outlook in section 5. 



2 Neutrino mass signature in (3-decay 

The energy spectrum N{E) of the /3-electrons of an allowed /3-decay is given by I14j : 
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Here E and m denote the kinetic energy and mass of the electron, Gp and 8c Fermi's constant and the 
Cabibbo angle, Mnuci the nuclear matrix element of the /3-decay, F{E, Z') the Fermi function describing 
the Coulomb interaction of the outgoing electron with the remaining daughter nucleus of charge Z' , 
Pj the probabilities to find the daughter ion after the /3-decay in an electronic or rotational-vibrational 
excitation with excitation energy Vj, and Eq the maximum possible kinetic energy of the /3-electron in 
case of m{i^i) — 0, which is the Q-value of the decay minus the recoil energy of the daughter [14 . 9 is 
the Heaviside function. 

Assuming a fourth sterile neutrino (or even a larger number of sterile neutrinos) requires to increase 
the number of neutrino flavor and mass states as well as the dimensions of the mixing matrix U : 
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The sum over the neutrino mass states in equation ([I]) will then run from i = 1 to i = 4. Now we 
introduce the following simplification: The three neutrino states vi, vi and vy, are assumed to have 
about the same mass m(i/iight) ~ fn(y\) k. miy-i) k. m(yz). This assumptiorj^ is supported by the small 
differences between the squared neutrino masses found in neutrino oscillations (see section 1). We can 
now sum up the first three terms jt/^jl in equation(ll|) and describe it by a single mixing angle 



\Vl^ =: cos2(i?), \\Jl^\ =: 



(3) 



^We could even allow small differences between the three light neutrino masses ra(y\), m{i'2), "i(f3) and expand the 
j-th component of the /3-spectrum to first order in r!n?(u{)/{Eo — Vj — E)'^ 14 . Then we can define the electron neutrino 
mass squared as average over all light mass eigenstates contributing to the electron neutrino: m?{uc) := I'/oiP rn?{ui), 

which would correspond to the mass of the light neutrino mass state m?(Vf.) ^ '"^(I'light)- 
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Equation (fTl) then simplifies to 



3 

+ sin2(^) .^{E^-V^-Ef- Tr?{v^) ■Q{E^-V;-E- m(y^))\^ . (4) 

From equation Q it is obvious that the endpoint region of a /^-spectrum is the most sensitive region 
to search for a contribution of a sterile neutrino with a mass m{i>4) = 0(1 eV). Therefore, tritium and 
^*^Re are the /^-emitters of choice due to their endpoint energies of Eq = 18.57 keV and Eq = 2.47 keV, 
respectively, which are the two lowest known /3-endpoint energies. Figure [l] shows a /3-spectrum near its 
endpoint Eq for an arbitrarily chosen contribution of a fourth sterile neutrino mass state. 
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(Eo-E) / eV 

Figure 1: Allowed /3-spectrum near the endpoint Eq with an admixture of a heavy neutrino with m^Vi) = 
2 eV, sin^(i9) — 0.3. The dashed line shows the /3-spectrum with the light neutrino state m(fiight) = eV 
only. 
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3 Phase II of the Mainz Neutrino Mass Experiment 



The Mainz Neutrino Mass Experiment was investigating the endpoint region of the tritium /3-spectrum 
from 1991 to 2001 to search for a non-zero neutrino mass [TSl [TB] . In the following we will only describe 
and discuss the data of the Mainz phase II (1998-2001) after the upgrade which took place from 1995 
until 1997. 

The Mainz Neutrino Mass Experiment used an integrating electrostatic retardation spectrometer 
with magnetic guiding and coUimating field of MAC-E-Filter type |l7j . This spectrometer type combines 
a large accepted solid angle with a high energy resolution. The retardation potential was created by a 
system of 27 cylindrical electrodes which were installed within an ultrahigh vacuum vessel of 1 m diameter 
and 3 m length. The /3-spectrum was scanned over the last 200 eV below the endpoint Eq by setting 
about 40 different retarding voltages and counting the corresponding number of transmitted /3-electrons. 
To eject stored electrons, which could cause background, from the spectrometer, HE pulses on one of 
the electrodes were applied for about 3 s every 20 s between the measurements at a constant retarding 
voltage. A system of 5 superconducting solenoids provided the magnetic guiding field for the /3-electrons 
from the tritium source in the first solenoid through a magnetic chicane through the spectrometer to 
a silicon detector. The tritium source consisted of a thin film of molecular tritium which was quench- 
condensed onto a cold graphite substrate and kept at a temperature below 2 K. By laser ellipsometry 
the film thickness was determined to be typically 150 monolayers. The magnetic chicane eliminated 
source-correlated background. The low temperature below 2 K avoided the roughening transition of the 
homogeneously condensed tritium films with time [T5]. Figure [2] illustrates the Mainz setup. 

In 1998, 1999 and 2001 in total 6 runs of about one month duration each were taken under good 
and well-controlled experimental conditions. These data were analyzed with regard to the neutrino mass 
m{Pe) [E]. The main systematic uncertainties of the Mainz experiment were the inelastic scattering 
of /3-electrons within the tritium film, the excitation of neighbor molecules due to sudden change of 
the nuclear charge during /3-decay, and the self-charging of the tritium film as a consequence of its 
radioactivity. As a result of detailed investigations in Mainz [121 1201 HIl US] - mostly by dedicated 
experiments - the systematic corrections became much better understood and their uncertainties were 
reduced significantly. The high-statistics Mainz phase II data (1998-2001) allowed the first determination 
of the probability of the neighbor excitation, which was found to occur in (5.0±1.6±2.2) % of all /3-decays 
|16j . in good agreement with the theoretical expectation [55]. 

The analysis of the last 70 eV below the endpoint of the phase II data gave no indication for a non-zero 




NEW GUIDING MAGNETS NEW HIGH FIELD ELECTRODES 

Figure 2: Illustration of the Mainz Neutrino Mass Experiment after its upgrade for phase II. The outer 
diameter of the spectrometer amounted to 1 m, the distance from source to detector was 6 m. See text 
for details. 
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neutrino mass (see also figure [s]) [16]. The result for the squared neutrino mass, 

m2(iye) = (-0.6±2.2±2.1) eV^ (5) 
corresponds - using the Feldman- Cousins method |23j - to an upper limit of 

m(z/e) < 2.3 eV (95 % C.L.). (6) 
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Figure 3: Averaged count rate of the Mainz 1998/1999 data (filled red squares) with fit for m(t'c)=0 (red 
line) and of the 2001 data (open blue squares) with fit for m{i'c)=0 (blue line) in comparison with previous 
Mainz data from 1994 (open green circles) as a function of the retarding energy near the endpoint Eq and 
effective endpoint i?o,cff- The latter takes into account the width of the response function of the setup 
and the mean rotation-vibration excitation energy of the electronic ground state of the '^HeT"'" daughter 
molecule. 
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4 Analysis of Mainz phase II data with respect to sterile neu- 
trino contribution 



We now analyze the six runs of the Mainz phase II data with regard to a possible contribution of a sterile 
neutrino. In the former Mainz phase II analysis the following four fit parameters were determined by 
a fit to the data: the electron neutrino mass sqaured m?(ya), the endpoint energy Eq, the normalizing 
amplitude a and a constant background rate h. 

For our sterile neutrino analysis we assume that the light neutrino mass can be neglected: m(fiight) = 
m{vg) = compared to the mass of the heavy sterile neutrino m{i'4). This is not only justified by the 
neutrino mass limit shown in equation (|6| but also from a similar limit of the neutrino mass experiment 
at Troitsk [211 and from even more stringent neutrino mass limits from cosmology (e.g. [H]). To describe 
the /3-spectrum including a fourth sterile neutrino mass state we use equation Q. Hence, we have now 
five fit parameters instead of the four fit parameters of the previous neutrino mass analysis: the squared 
mass of the heavy sterile neutrino to^(z/4), its contribution by mixing sin^ i?, the endpoint energy Eq, the 
normalizing amplitude a and a constant background rate b. 

In all other respects we do exactly the same as for the Mainz phase II analysis [16,. This includes using 
the same data sets of the six runs, which comprise the measured count rates as a function of the retarding 
voltage U, as well as applying the same so-called response function T'{E,U) of the Mainz apparatus. 
Our fit function F{U) should describe the expected count rate as function of the retarding voltage U of 
the spectrometer. To obtain this fit function the /3-spectrum N{E) including a fourth, sterile neutrino 
Q is convolved with the response function T'{E, U) of the apparatus and a constant background rate h 
is added: 



The response function T'(E, U) itself is a fivefold convolution of the transmission function Tspec of the 
spectrometer of MAC-E-Filter type, the energy loss function of the /3-electrons in the T2 film /loss [IS], 
the charge-up potential in the film /charge [H], the backscattering function from the graphite (HOPG) 
substrate /back, and the energy dependence of the detector efficiency /det [H]: 



The five functions Tspcc, /loss, /charge, /back, /det are described in detail in the Mainz phase II analysis 
paper [16j and we copy the former analysis methods by even applying the same computer programs for 
these five functions and for T'{E, U). 

For calculating the /3-spectrum we use the final states distribution from the Mainz phase II analysis 
including also the excitation of neighboring T2 molecules during the /3-decay and small shifts of 
higher excited electronic states in solid T2 with respect to gaseous T2 as described in the Mainz phase 
II analysis [16] . Although there are two slightly updated final states distributions [27l the differences 
are so tiny that we still used the one i26i which has been applied for the Mainz phase II analysis. 

Fitting was done by the usual minimization method applying the program minuit from CERN. 
Our systematic uncertainties we derived in the same way as for the Mainz phase II analysis: For every 
parameter p with systematic uncertainty Ap, e.g. the thickness of the T2 film, we performed the whole 
fitting three times, with the parameter set to p, to p — Ap and to p + Ap, respectively. The obtained 
variations in our observable of interest sin^ 'd for a fixed mass squared of the fourth neutrino mass state 
771^(^/4) defined the systematic uncertainty to our observable ±lcrp_sys(sin^ i?) by the parameter p. Since 
the uncertainty Ap of the parameter p, e.g. the uncertainty of the film thickness, usually differs among 
the six data sets we calculated the correct average by minimizing the for all six data sets together, as 
described in the Mainz phase II analysis jTB] . 

We do not want to repeat here the detailed explanation of all the systematic uncertainties because 
we adopt them from the Mainz phase II analysis fl6L Instead we just list the systematic uncertainties 
taken into account: The shift of the energy of excited first and second electronic final state groups in 




(7) 



T'{E, U) = Tspcc ® /loss ® /charge ® /back ® /det- 



(8) 
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Table 1: List of systematic corrections and their relative uncertainties as from reference [16] . 



correction 


relative uncertainty 


shift of excited electronic final states 


1 


inelastic cross section 


0.054 


film thickness 


0.03 


film coverage by condensing H2 


1 


neighbor excitation 


0.28 


self-charging of the tritium film 


0.2 


energy dependence of detector efficiency & backscattering 


0.5 



solid T2 w.r.t. gaseous T2, the uncertainties of the inelastic cross section and of the thickness of the 
T2 films, of the coverage of the T2 films by condensing H2 gas with time, of the probability to excite 
neighboring T2 molecules by the /3-decay, of the correction for the self-charging which the electrically 
insulating T2 film undergoes as it loses /3-electrons continuously, of the backscattering of /3-electrons in 
the HOPG substrate, and of the energy-dependence of the detector efficiency. The relative uncertainties 
of these corrections are listed in table [H 

The final result on the light neutrino mass squared in equation ([5| was obtained by fitting the last 70 eV 
of the /3-spectrum. In the sterile neutrino analysis we also used the last 70 eV of the measured /3-spectra 
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Figure 4; Fit results on the contribution sin^ of a fourth neutrino mass state 1^4 from the analysis of the 
Mainz phase II data as function of the squared mass rn^^v^). The inner (green) error bars correspond to 
the statistical, the outer (red) to the total uncertainty. The blue line above the points with error bars 
gives the upper limit according to the Feldman- Cousins method [53] with 90 % C.L. 
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sln^(2'iy) 

Figure 5: Favored region of the so-called reactor neutrino anomaly at 90 % C.L. in blue and at 95 % C.L. 
in green as function of the mixing of the fourth neutrino mass state to the electron neutrino sin^(2i9) and 
the squared mass difference of the fourth neutrino mass state to the light neutrino mass states Ato^,,^ 
(courtesy of T. Lasserre). The red curves represent the limits from this analysis at 68 % C.L. (dashed), 
90 % C.L. (solid) and 95 % C.L. (dotted), respectively. The parameter regions right of and above the 
curves are excluded. Here we neglect a possible non-zero value of the light neutrino mass states and show 
the limits for m?{v4) = Am^g^. 

of the six runs for heavy neutrino masses m (1/4) < 1000 eV^; for larger 771(1/4) we extended the fit range 
proportional to 777(7/4) up to fitting the last 200 eV of the measured /3-spectra for 777^(7/4) = 20000 eV^. 

Figure [4] shows the fit results for the contribution sin^ i9 as a function of the squared mass of the 
fourth neutrino mass state 777^(7/4). For small 777^(7/4) the sensitivity decreases due to lack of statistics. 
For large squared masses 70,^(7/4) the variation in sensitivity is caused by the fact that the measurement 
points of the Mainz phase II runs are not equally distributed along the energy scale. No indication of a 
contribution of a fourth neutrino mass state is found, the contribution sin^ i9 is compatible with zero for 
all squared masses m'^{vi) of the fourth neutrino mass state under investigation. The line above the fit 
points gives the corresponding upper limit according to the Feldman- Cousins method at 90 % C.L. |23j . 

Figure [5] shows the parameter space favored in order to explain the reactor neutrino anomaly by the 
mixing of a fourth neutrino mass state 2J together with the limit on this fourth neutrino mass state from 
our analysis. The phase II data of the Mainz Neutrino Mass Experiment allow to exclude a small fraction 
of the favored parameter space at large Am'^. 
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5 Conclusion and outlook 



Our re-analysis of the phase II data of the Mainz Neutrino Mass Experiment with regard to a potential 
contribution of a fourth neutrino mass state to the electron neutrino does not give any hint for the 
existence of such a state. The contribution sin^ i9 is compatible with zero for all squared masses of 
the fourth neutrino mass state under investigation (3 eV^ < mP'ivi) < 30,000 eV^). The Mainz data 
constrain a small fraction of the parameter space for such a fourth neutrino mass state favored by the 
attempt to explain the reactor neutrino anomaly and other indications. 

The Karlsruhe Tritium Neutrino experiment KATRIN [21] will investigate the endpoint region of 
the tritium /3-decay with much higher statistics, better energy resolution and much smaller systematic 
uncertainties. The KATRIN experiment will reach a factor 10 higher sensitivity on the electron neutrino 
mass of 200 meV compared to the sensitivity of the Mainz Neutrino Mass Experiment as reported 
in equation The data from the KATRIN experiment will also allow to investigate the potential 
contribution of a fourth neutrino mass state to the electron neutrino with a sensitivity [5D1 [311 [32] 
covering the whole favored region of the reactor neutrino anomaly. 

A fourth neutrino mass state with a mass of a few keV acting as Warm Dark Matter is another 
possibility, which derives its motivation from recent efforts of explaining the structure of the universe at 
galactic and super-galactic scales {missing satellite galaxy problem) [33]. Such a neutrino might also be 
investigated by /3-decay studies [34] . 
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